Tool-supported fault localization in spreadsheets: Limitations of current evaluation practice
نویسندگان
چکیده
In recent years, researchers have developed a number of techniques to assist the user in locating a fault within a spreadsheet. The evaluation of these approaches is often based on spreadsheets into which artificial errors are injected. In this position paper, we summarize different shortcomings of these forms of evaluations and sketch possible remedies including the development of a publicly available spreadsheet corpus for benchmarking as well as user and field studies to assess the true value of the proposed techniques.
منابع مشابه
Toward Sharing Reasoning to Improve Fault Localization in Spreadsheets
Although researchers have developed several ways to reason about the location of faults in spreadsheets, no single form of reasoning is without limitations. Multiple types of errors can appear in spreadsheets, and various fault localization techniques differ in the kinds of errors that they are effective in locating. Because end users who debug spreadsheets consistently follow the advice of fau...
متن کاملImproving dependency-based models for fault localization in spreadsheets
Locating faults in spreadsheets can be difficult. Therefore, tools supporting the localization of faults are needed. Model-based software debugging (MBSD) is a promising fault localization technique. This paper presents a novel dependency-based model that can be used in MBSD. This model allows improvements of the diagnostic accuracy while keeping the computation times short. In an empirical eva...
متن کاملQualitative deviation models vs. quantitative models for fault localization in spreadsheets
Automatizing fault localization in programs has been an interesting and active research field for several decades. In order to increase efficiency at least tool support for debugging would be highly required. This holds even more for end-user programs like spreadsheets. In this paper, we discuss three different models for spreadsheet debugging where one relies on qualitative algebra and deviati...
متن کاملOn the Empirical Evaluation of Fault Localization Techniques for Spreadsheets
Spreadsheets are by far the most prominent example of enduser programs of ample size and substantial structural complexity. In addition, spreadsheets are usually not tested very rigorously and thus comprise faults. Locating faults is a hard task due to the size and the structure, which is usually not directly visible to the user, i.e., the functions are hidden behind the cells and only the comp...
متن کاملCombining Smells and Fault Localization in Spreadsheets
Despite being staggeringly error prone, spreadsheets are a highly flexible programming environment that is widely used in industry. In fact, spreadsheets are widely adopted for decision making, and decisions taken upon wrong (spreadsheet-based) assumptions may have serious economical impacts on businesses, among other consequences. This paper proposes a technique to automatically pinpoint poten...
متن کامل